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Abstract 



This paper, investigates the conditional quantile estimation of a scalar random response 

and a functional random covariate (i.e. valued in some infinite-dimensional space) whenever 

functional stationary ergodic data with random censorship are considered. We introduce a kernel 

Ci type estimator of the conditional quantile function. We establish the strong consistency with 

H rate of this estimator as well as the asymptotic normality which induces a confidence interval 

'— ^ that is usable in practice since it does not depend on any unknown quantity. An application 

. to electricity peak demand interval prediction with censored smart meter data is carried out to 

^ show the performance of the proposed estimator. 

<^) Keywords: Asymptotic normality, censored data, conditional quantiles, ergodic processes, 

C^ functional data, interval prediction, martingale difference, peak load forecasting, strong consis- 

^T tency. 
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^^ 1 Introduction 



K>" Functional data analysis is a branch of statistics that has been the object of many studies and 

K^ developments these last years. This kind of data appears in many practical situations, as soon 

H as one is interested in a continuous-time phenomenon for instance. For this reason, the possible 

application fields propitious for the use of functional data are very wide: climatology, economics, 
linguistics, medicine, .... Since the works of Ramsay and Dalzell (1991), many developments have 
been investigated, in order to build theory and methods around functional data, for instance how it 
is possible to define the regression function and the quantile regression function of functional data, 
what kind of model it is possible to consider with functional data. The study of statistical models for 
infinite dimensional (functional) data has been the subject of several works in the recent statistical 
literature. We refer to Bosq (2000), Ramsay and Silverman (2005) in the parametric model and 
the monograph by Ferraty and Vieu (2006) for the nonparametric case. There are many results for 
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nonparametric models. For instance, Ferraty and Vieu (2004) established the strong consistency 
of kernel estimators of the regression function when the explanatory variable is functional and the 
response is scalar, and their study is extended to non standard regression problems such as time 
series prediction or curves discrimination by Ferraty et al. (2002) and Ferraty and Vieu (2003). The 
asymptotic normality result for the same estimator in the alpha-mixing case has been obtained by 
Masry (2005). 

In addition to the regression function, other statistics such as quantile and mode regression could be 
with interest for both sides theory and practice. Quantile regression is a common way to describe the 
dependence structure between a response variable Y and some covariate X. Unlike the regression 
function (which is defined as the conditional mean) that relies only on the central tendency of 
the data, conditional quantile function allows the analyst to estimate the functional dependence 
between variables for all portions of the conditional distribution of the response variable. Moreover, 
quantiles are well-known by their robustness to heavy-tailed error distributions and outliers which 
allows to consider them as a useful alternative to the regression function. 

Conditional quantiles for scalar response and a scalar /multivariate covariate have received con- 
siderable interest in the statistical literature. For completely observed data, several nonparametric 
approaches have been proposed, for instance, Gannoun et al. (2003) introduced a smoothed estima- 
tor based on double kernel and local constant kernel methods and Berlinet et al. (2001) established 
its asymptotic normality. Under random censoring, Gannoun et al. (2005) introduced a local lin- 
ear (LL) estimator of quantile regression (see Koenker and Bassett (1978) for the definition) and 
El Ghouch and Van Keilegom (2009) studied the same LL estimator. Ould-Said (2006) constructed 
a kernel estimator of the conditional quantile under independent and identically distributed (i.i.d.) 
censorship model and established its strong uniform convergence rate. Liang and de Una-Alvarez 
(2011) established the strong uniform convergence (with rate) of the conditional quantile function 
under a-mixing assumption. 

Recently, many authors are interested in the estimation of conditional quantiles for a scalar 
response and functional covariate. Ferraty et al. (2005) introduced a nonparametric estimator 
of conditional quantile defined as the inverse of the conditional cumulative distribution function 
when the sample is considered as an a-mixing sequence. They stated its rate of almost complete 
consistency and used it to forecast the well-known El Nino time series and to build confidence 
prediction bands. Ezzahrioui and Ould-Said (2008) established the asymptotic normality of the 
kernel conditional quantile estimator under a-mixing assumption. Recently, and within the same 
framework, Dabo-Niang and Laksaci (2012) provided the consistency in L^ norm of the conditional 
quantile estimator for functional dependent data. 

In this paper we investigate the asymptotic properties of the conditional quantile function of 
a scalar response and functional covariate when data are randomly censored and assumed to be 
sampled from a stationary and ergodic process. Here, we consider a model in which the response 
variable is censored but not the covariate. Besides the infinite dimensional character of the data, 
we avoid here the widely used strong mixing condition and its variants to measure the dependency 
and the very involved probabilistic calculations that it implies. Moreover, the mixing properties of 
a number of well-known processes are still open questions. Indeed, several models are given in the 
literature where mixing properties are still to be verified or even fail to hold for the process they 
induce. Therefore, we consider in our setting the ergodic property to allow the maximum possible 
generality with regard to the dependence setting. Further motivations to consider ergodic data are 
discussed in Laib and Louani (2010) where details defining the ergodic property of processes are also 



given. As far as we know, the estimation of conditional quantile combining censored data, ergodic 
theory and functional data has not been studied in statistical literature. 

The rest of the paper is organized as follows. Section 2 introduces the kernel estimator of the 
conditional quantile under ergodic and random censorship assumptions. Section 3 formulates main 
results of strong consistency (with rate) and asymptotic normality of the estimator. An application 
to peak electricity demand interval prediction with censored smart meter data is given in Section 4. 
Section 5 gives proofs of the main results. Some preliminary lemmas, which are used in the proofs 
of the main results, are collected in Appendix. 

2 Notations and definitions 

2.1 Conditional quantiles under random censorship 

In the censoring case, instead of observing the lifetimes T (which has a continuous distribution 
function (df) ) we observe the censored lifetimes of items under study. That is, assuming that 
{Ci)i<i<n is a sequence of i.i.d. censoring random variable (r.v.) with common unknown continuous 
df G.~ ~ 

Then in the right censorship model, we only observe the n pairs (1^, 5i) with 

Yi = Ti Ad and 6i = I^t.kc,}^ I < i < n, (1) 

where H^ denotes the indicator function of the set A. 

To follow the convention in biomedical studies and as indicated before, we assume that (Cj)i<i<n 
and (Tj, Xj)i<j<„ are independent; this condition is plausible whenever the censoring is independent 
of the modality of the patients. 

Let (X, T) he E X M-valued random elements, where E is some semi-metric abstract space. 
Denote by d{-, •) a semi-metric associated to the space E. Suppose now that we observe a sequence 
{Xi,Ti)i>i of copies of {X,T) that we assume to be stationary and ergodic. For x £ E, we denote 
the conditional probability distribution of T given X = x by: 

yt£R, F{t\x) = F{T <t\X = x). (2) 

We denote the conditional quantile, of order a G (0, 1), of T given X = x, by 

qa{x) = inf{t : F{t \ x) > a}. (3) 

We suppose that, for any fixed x £ E, F(- \ x) be continuously differentiable real function, and 
admits a unique conditional quantile. 

Let a G (0, 1), we will consider the problem of estimating the parameter qa{x) which satisfies: 

F{qa{x) \x)=a. (4) 

2.2 A nonparametric estimator of conditional quantiles 

It is clear that an estimator of qa{x) can easily be deduced from an estimator of F{t \ x). Let us 
recall that in the case of complete data, a well-known kernel-estimator of the conditional distribution 
function is given by 

n 
Fn{t \X)=Y, Wn,i{x) HiK^uit - m, (5) 



where 



K(h-^j,dix,X,) 

WnA^) = ^^^ ^> (6) 



are the well-known Nadaraya- Watson weights. Here i^ is a real- valued kernel function, H a cumu- 
lative distribution function and hx '■= hn^K (resp. hu := hn^n) a sequence of positive real numbers 
which decreases to zero as n tends to infinity. This estimator given by (5) has been introduced in 
Ferraty and Vieu (2006) in the general setting. 

An appropriate estimator of the conditional distribution function F{t \ x) for censored data is 
then obtained by adapting (6) in order to put more emphasis on large values of the interest random 
variable T which are more censored than small one. Based on the same idea as in Carbonez et al. 
(1995) and Khardani et al. (2010), we consider the following weights 

where G{-) = 1 — G{-). Now, we consider a "pseudo-estimator" of F{t \ x) given by: 
p ., I ^ ELi S^G-\Y,)K {h-^U{x,X,)) H{h-^\t - Y,)) _ Fn{x,t) 

where 

1 " - 

^"^"^'^^ = nE(Ai(x)) ^ ^-^''(^-) ^ i'^nit - Y,)) A,(x), 

and 

1 " 

nlli(Ai(2;jj ^ 

where Aj(x) = K (d{x,Xi)/hK)- In practice G is unknown, we use the Kaplan and Meier (1958) 
estimator of G given by: 

G„(,)=(nL,(l-i^)'(^'-"' if ,<y„.„ 
[ Otherwise, 

where Yn\ < Ym < • • • < Yr^) are the order statistics of (li)i<i<r!, and 6u\ is the concomitant of 
Yuy Therefore, the estimator of F{t \ x) is given by: 

F„«|.) = ^. (9) 



where 



1 " - 



i=l 



Then a natural estimator of qaix) is given by: 

qn,a{^) = inf{y : -F„(y | x) > a}, (10) 

which satisfies: 

Fn{qn,a{x) \ x) = a. (11) 

3 Assumptions and main results 

In order to state our results, we introduce some notations. Let J-^ be the (7-field generated by 
{{Xi,Ti), ..., {Xi, Ti)) and Qi the one generated by ((Xi, Ti), . . . , (Xj, Tj), Xj+i) . Let B{x, u) be 
the ball centered at a; G -E with radius u. Let Di{x) := d{x, Xi) so that Di{x) is a nonnegative real- 
valued random variable. Working on the probability space {Q,A,P), let Fx{u) = P {Di{x) < u) := 
P {Xi G B{x, u)) and Fx'~^ (u) = P ( A(x) < u \ Fi-i) = P (Xj G B{x, u) \ Fi-i) be the distribution 
function and the conditional distribution function, given the a- field -Fj-i, of {Di{x))i>i respectively. 
Denote by Oa.s.(w) a real random function H. such that l!.{u)/u converges to zero almost surely as 
ti — 7- 0. Similarly, define Oa.s.{'^) ^ ^^^1 random function I such that i{u)/u is almost surely bounded. 
Furthermore, for any distribution function L, let tl = sup{t,such that L{t) < 1} be the support's 
right endpoint. Let S* be a compact set such that qa{x) £ S U (—00, r], where t < tq f\ Tp- 

3.1 Rate of strong consistency 

Our results are stated under some assumptions we gather hereafter for easy reference. 

(Al) i^ is a nonnegative bounded kernel of class C^ over its support [0, 1] such that K{1) > 0. 
The derivative K' exists on [0, 1] and satisfy the condition K'{t) < 0, for all t G [0, 1] and 
I J^{Kiy{t)dt\ < 00 for j = 1, 2. 

(A2) For X G E, there exists a sequence of nonnegative random functionals (/j,i)i>i almost surely 
bounded by a sequence of deterministic quantities (6j(x))j>i accordingly, a sequence of random 
functions {gi^x)i>i, a deterministic nonnegative bounded functional /i and a nonnegative real 
function (p tending to zero, as its argument tends to 0, such that 

(i) Fx{h) = 4>{h)h{x) + o(0(/i)) as /i ^ 0. 
(ii) For any i G N, F^'-\h) = (l){h) fi^i{x) + gi,x{h) with gi^^ih) = Oa.s.{(t>{h)) as h ^ 0, 

gi,x{h)/(p{h) almost surely bounded and 'n'~^ ^17=1 9i x(^) ~ '^a.sX'P^W) as n — )■ 00, 

J = 1,2. 

(iii) n^^ X^r=i fiii-^) ~^ fi{^)-> almost surely as n — )■ 00, for j = 1, 2. 

(iv) There exists a nondecreasing bounded function tq such that, uniformly in s G [0,1], 
<j){hs) 
4,(h) 

(v) n~^ Yl^=i bi{x) — )■ D{x) < cx) as n — )■ cxD. 



^^ - To(s) + 0(1), as /i i and, for j > 1, J^{K^{t)yTo{t)dt < 00. 



(A3) The conditional distribution function F{t \ x) has a positive first derivative with respect to t, 
for all X £ E, denoted f{t \ x) and satisfies 



(ii) Jjjj \t\f{t I x)dt < oo, for all x £ E, 

(ii) For any x £ E, there exist V{x) a neighborhood of x, some constants Cx > 0, f3 > and 
h' > 0, such that for j = 0, 1, we have V(ti,t2) £ S x S, \/{xi,X2) G y(x) x V{x), 



F^^\ti 



xi, 



F^^\t 



2 X2 



(A4) For any m > 1 and j = 0, 1, E {H(^\hjj\t - Tj)))'" | Gi^ 



<Cjd{xi,X2f + \h-t2\''). 



E 



{HU\hJ,\t - T,))r\ X, 



(A5) The distribution function H has a first derivative H'^^' which is positive and bounded and 
satisfies f \u\'^H^^'{u)du < oo. 

(A6) For any x' £ E and m > 2, sup^g^ \g„^{x',t)\ := sup^g^ |E[iJ™(/i^^(t - Ti)) | Xi = x']| < oo 
and gm{x',t) is continuous in V{x) uniformly in t: 

sup sup \gmix',t) - gm{x,t)\= o{l). 

teS x'&B{x,h) 



(A7) {Cn)n>iand{Tn,X, 



n)n>l 



are independent. 



Comments on hypothesis: Conditions (Al) involves the ergodic nature of the data and the small ball 
techniques used in this paper. Several examples where condition (Al)(ii) is satisfied are discussed in 
Laib and Louani (2011). Assumption (A3)(ii) involves the conditional probability and conditional 
probability density, it means that F{- \ •) and /(• | •) are continuous with respect to each vari- 
able. Assumption (A4) is of Markov's nature. Hypothesis (Al) and (A5) impose some regularity 
conditions upon the kernels used in our estimates. Condition (A6) stands as regularity condition 
that is of usual nature. The independence assumption between (Cj)j and {Xi,Ti)i, given by (A7), 
may seem to be strong and one can think of replacing it by a classical conditional independence 
assumption between (Cj)j and (Tj)i given {Xi)i. However considering the latter demands an a priori 
work of deriving the rate of convergence of the censoring variable's conditional law (see Deheuvels 
and Einmahl (2000)). Moreover our framework is classical and was considered by Carbonez et al. 
(1995) and Kohler et al. (2002), among others. 



Proposition 3.1 Assume that conditions (A1)-(A7) hold true and that 

logn 



n4){hK) — >■ oo and 



n(j){hK) 



as n 



oo. 



(12) 



Then, we have 



sup 

teS 



Oa.s.[h'K + h'h)+Oa.s. 



Fn{t \x)-F{t\x 
Theorem 3.2 Under the same assumptions of Proposition 3.1, we have 

qn,a{^) - qa{x) = Oa.s. (h'^K + ^Hj + Oa.s. J ,,, x 



logn 



n(t>{hK) 



(13) 
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3.2 Asymptotic normality 

The aim of this section is to estabhsh the asymptotic normahty which induces a confidence interval 
of the conditional quantiles estimator. For that purpose we need to introduce further notations and 
assumptions. We assume, for /c = 1,2, that ¥,(^\diG~^{Yi)H{h'Jj (t — Yi))|'^) < oo and that, for a 
fixed x G -E, the conditional variance, of 6iG^^(Yi)H{hJj (f — Yi)) given Xi = x, say, 

W2{t \x):=E USiG-\Yi)H{hJj^{t - Yi)) - F{t \ x))^ \ Xi = x] exists. 

(A8) (i) The conditional variance of 6iG^^{Yi)H{hJj [t — Yi)) given the cr-field Qi^i depends only 
onXi, i.e., for any z > 1, E \{5^G-\Yi)H{h-^\t - Yi)) - F{t \ X^))' | ^i^i] = W2it \ Xi) 
almost surely, 
(ii) For some 5 > 0, E[\5iG-'^{Yi)H{hjl{t - Yi))\^+^] < oo and the function 

W2+s{t I u) ■= E{\6iG-^{Yi)H{hjl{t-Yi))-F{t \ x)p+^ \Xi = u),ue E, is continuous 
in a neighborhood of x. 

(A9) The distribution function of the censored random variable, G has bounded first derivative 

Theorem 3.3 Assume that assumptions (A1)-(A9) hold true and condition (12) is satisfied, then 
we have 



VnHhx) (hit I x) - Fit I x)) A AA (O, a\x, t)) 

n distribution and 

M2F{t\ x) {G^^t) - F{t \ x)) 



where — > denotes the convergence in distribution and 



""^""'^^'Mf h{x) 

where Mj = K^{1) - f^{K^)'To{u)du. 
Theorem 3.4 Under the same assumptions and conditions of Theorem 3.3, we have 



■s/n4){hK) {qn,a{x) - qa{x)) — > N (0, 7^(x, qa{x))) , 

a^{x,qo,{x)) _ Ma a[G-^{qo,{x)) - a] 



7 (X,ga(x)) 



P{qa{x)\x)) Mlh{x) P{qa{x)\x)) • 

Observe that in Theorem 3.4 the limiting variance, for a given x G i?, 7^(- | x) contains the unknown 
function /i(-), the normalization depends on the function (/>(•) which is not identifiable explicitly and 
the theoretical conditional quantile (7q,(x). Moreover, we have to estimate the quantities /(• | x), 
ro(-) and G{-). The corollary below allows us to get a suitable form of Central Limit Theorem which 
can be used in practice to estimate interval prediction. First of all, we give an estimator of each 
unknown quantity in Theorem 3.4. To estimate, for a fixed x £ E, 7(- | x) the quantities G(-), 
F(- I x) and qaix) should be replaced by their estimators G'„(-), -F„(- | x) and qn,a{x) respectively. 
Now, using the decomposition given by assumption (A2)(i), one can estimate tq{u) by Tn{u) = 
Fx,n{uh)/Fx^n{h), where F^^niu) = l/'^Z^ILi '^{d{x,Xi)<u}- Therefore, for a given kernel K, an esti- 
mators of Ml and M2, namely Mi^„ and M2,n respectively, are obtained by plug-in t„, in place of 
To, in their respective expressions. 



3.3 Application to predictive interval 

Corollary 3.5 Assume that conditions (A1)-(A9) hold true, K' and {K"^)' are integrable functions 
and 

Mi... /,.(|^.) I .) r ..F,,!/.,.) ^^^^^^^^ _ ^^_^j^|| ^ ^^^_ ^^^ 

where fn{- \ x) is an estimator of the conditional density function /(• | x). 

The corollary 3.5 can be now used to provide the 100(1 — a)% confidence bands for qa{x) which 
is given, for x E E', by 



(x) ± Ca/2 



Mi^n fniqa,nix) I x) a {Gn^ {qa^n{x)) - o) 



where Cq,/2 is the upper a/2 quantile of the distribution of AA(0, 1). In the following section we give 
an application of this corollary for interval prediction of the daily electricity peak demand under 
random censorship. 

4 Interval prediction of peak load with censored smart meter data 

The evolution of peak electricity demand can be considered an important system design metric for 
grid operators and planners. In fact, overall electricity demand and the daily schedules of electricity 
usage are currently major influences on peak load. In the future, peak load will be influenced by new 
or increased demands such as the penetration of clean energy technologies (wind and photovoltaic 
generation), such as electric vehicles and the increased use of electricity for heating and cooling 
through technologies such as heat pumps. Smart grid technology, through the use of advanced 
monitoring and control equipment, could reduce peak demand and thus prolong and optimize use of 
the existing infrastructure. Regularly, the electricity network constraints are evaluated on a specific 
area in order to prevent over-voltage problems on the grid. Very localized peak demand forecasting 
is needed to detect voltage constraints on each node and each feeder in the Low- Voltage network. 

Peak demand forecasting of aggregated electricity demand has been widely studied in statistical 
literature and several approaches have been proposed to solve this issue, see for instance, Sigauke 
and Chikobvu (2012) and Goia and Fusai (2010) for short-term peak forecasting and Hyndman and 
Fan (2010) for long-term density peak forecasting. The arrival of Automated Meter Reading (AMR) 
allows us to receive energy demand measurement at a finite number of equidistant time points, e.g. 
every half-hour or every ten minutes. As far as we know, nothing has been done for household-level 
peak demand forecasting. In this section we are interested in the estimation of interval prediction of 
peak demand at the customer level. For a fixed day d, let us denote by (>Crf(tj))j=i^...^24 the hourly 
measurements sent by the AMR of some specific customer. The peak demand observed for the day 
d is defined as 

Vd = max Cd{tj). 

The transmission of the consumed energy from the AMR to the system information might be made, 
for instance, by wireless technology. Unfortunately, in practice we cannot receive on time the hole 





Figure 1: Hourly measurements for electricity demand and temperature for 1000 days. 

measurements for every day. In fact many sources of such kind of censorship could arise, for instance 
an interruption in the wireless communication during the day or a physical problem with the AMR. 
Whenever we receive the hole data one can determine the peak for that day, otherwise (when data 
are censored) we cannot calculate the true peak. In such case one can delete that observation 
from the sample which leads to reduce the available information. In this paper we suggest to keep 
censored observations in our sample and use them to predict peak demand intervals. 

It is well-known that peak demand is very correlated with temperature measurments. Figure 1 
shows the hourly measurements of electricity demand and temperature during 1000 days. One can 
easily observe a seasonality in the load curve which reflects the sensitivity of energy consumption, for 
that customer, to weather conditions. Figure 2 provides a sample of 10 curves of houly temperature 
measures and the associated electricity demand curves. Observed peak, for each day, is plotted in 
solid circles. We split our sample of 1000 days into learning sample containing the first 970 days 
and a testing sample with the last 30 days. From the learning sample we selected 30% of days 
within which we generated randomly the censorship. Figure 3 provides a sample of 6 censored daily 
load curves. For those days, the AMR send hourly electricity consumption until a certain time 
tc G [1, 24] which corresponds to the time of censorship which is plotted in dashed line in Figure 3. 
For a censored day, we define the censored random variable 



Cd = .max Cd{tj 



l,...tc 



v^ 



where tc is the time from which we don't receive data from the smart meter. Therefore, our sample 
is formed as follow {Xci,Yd)d=i,...,970, where Xd is the predicted temperature curve for the day d 
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Figure 2: A sample of 10 daily temperature curves and the associated electricity demand curves. 
Observed daily peaks are in solid circle. 
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Figure 3: A sample of 6 censored daily load curves. Observed values of electricity consumption are 
plotted in star points, dashed line corresponds to the time of censorship for each day. 
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Wk predictive intervals 




Days 



Figure 4: 



predictive intervals of the peak demand for the last 30 days. 



and Y(i = Vd for completely observed days and Y(i = Cd for censored ones. Here, we investigate, for 
each day d = 971, . . . , 1000, the conditional quantile functions of Yd given the predicted temperature 
curve Xd- The 5% and 95% quantiles consists of the 90% confidence intervals of the last 30 peak load 
in the testing sample, say [go.05(-^d)) '7o.95(^d)] for d = 971, . . . , 1000. Note that these confidence 
intervals are derived directly from the conditional quantile functions given by (10). To estimate 
conditional quantiles we chose the quadratic kernel defined by K{u) = 1.5(1 — u^)]lro_ii. Because the 
daily temperature curves are very smooth, we chosed as semi-metric d(-, •) the L2 distance between 
the sec ond derivative of the curves. Finally, we considered the optimal bandwidth h := Kk = hn 
chosen by the cross-validation method on the fc-nearest neighbors (see Ferraty and Vieu (2006), 
p. 102 for more details). Figure 4 provides our results for the peak load interval prediction for the 
testing sample. The true peaks are plotted in solid triangles. Solid circles represent the conditional 
median values. On can easily observe that the conditional median is a consistent predictor of the 
peak. In fact, let us define the Mean Absolute Prediction Error as 



30 



MAPE 



I ^\Vd- qoA^d 



30 



E 



■Pd 



where Vd is the true value of the peak for the day d and go. 5 i^d) its predicted value based on the 
conditional median. We obtain here MAPE = 0.24. Observe that we over-estimate the peak of the 
16th day. 
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5 Proofs of main results 

In order to proof our results, we introduce some further notations. Let 



and 



Now, lets introduce the decomposition hereafter. For x £ E, set 



Fn{t I x) - F{t I x) = Fn{t I x) - Fn{t \ x) + F„(t | x) - F{t I x). (14) 

To get the proof of Proposition 3.1, we establish the following Lemmas. 

Definition 5.1 A sequence of random variables (Z„)„>i is said to he a sequence of martingale 
differences with respect to the sequence of a-fields {J-n)n>i whenever Zn is Tn measurable and 
E {Zn I Fn-\) = almost surely. 

In this paper we need an exponential inequality for partial sums of unbounded martingale differ- 
ences that we use to derive asymptotic results for the Nadaraya- Watson-type multivariate quantile 
regression function estimate built upon functional ergodic data. This inequality is given in the 
following lemma. 

Lemma 5.2 Let {Zn)n>i be a sequence of real martingale differences with respect to the sequence 
of a-fields [Tn = cr(Zi, . . . , Zn))n>i, where 0"(Zi, . . . , Z„) is the a-filed generated by the random 
variables Zi, . . . , Zn- Set Sn = Y17=i ^*- ^^''^ ^''^y P — ^ '^"-'^ ^''^H ^ ^ 1; assume that there exist 
some nonnegative constants C and dn such that 

E(ZP I Fn-i) < CP-'^pldl almost surely. (15) 

Then, for any e > 0, we have 

P(|5„|>.)<2exp{-^l^^ 

where Dn = Y^^idf. 

As mentioned in Laib and Louani (2011) the proof of this lemma follows as a particular case of 
Theorem 8.2.2 due to de la Peha and Gine (1999). 

We consider also the following technical lemma whose proof my be found in Laib and Louani 
(2010). 
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Lemma 5.3 Assume that assumptions (Al) and (A2)(i), (A2)(ii) and (A2)(iv) hold true. For any 
real numbers 1 < j < 2 + 5 and 1 < k < 2 + 6 with 6 > 0, as n ^ oo, we have 



(u) 
(Hi) 



1 



(l){hK 
1 



-E 



(p{h 



-E 



K 



^H^k) 



A{{x)] =MjMx)+o{1), 
(E(Ai(x))f = Mi'=/f(x) + o(l). 



9i,x{h 



K) 



Hh 



Kj 



Lemma 5.4 Assume that hypotheses (Al)-(A2) and the condition (12) are satisfied. Then, for any 
X £ E, we have 



(i) £n{x) -in{x) = Oa.s. 



logn 



n<j){hK))' 
(a) lim„^oo-^n(2;) = lim„^oo^n(a;) = 1 a.s.. 

Proof. See the proof of Lemma 3 in Laib and Louani (2010). 



□ 



Proof, of Proposition 3.1 

Making use of the decomposition (14), the result follows as a direct consequence of Lemmas 5.5 and 
5.6 below. 



Lemma 5.5 Under Assumptions (A1)-(A7) and the condition (12) , we have 

Fn{t I X) - F{t I X) = Oa.sXh^K + ^h) + Oa.s. 



sup 

te5 



logn 



ncpikx) 



Lemma 5.6 Assume that hypothesis (A1)-(A7) and the condition (12) hold, we have 

Fn{t \ X) - Fn{t \ X) =Oa.s. 



sup 

tes 



log log n 



n 



We provide, in the following lemma, the almost sure consistency, without rate, of qn,a{x)- 
Lemma 5.7 Under assumptions of Proposition 3.1, we have 



lim 

n— >-oo 



qn,a{x) - qa{x) 



0, a.s. 



□ 
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Proof, of Lemma 5.7 

Following the similar steps as in Ezzahrioui and Ould-Said (2008), the proof of this lemma is based 
in the following decomposition. As F{- | x) is a distribution function with a unique quantile of order 
a, then for any e > 0, let: 



r/(e) = mm{F{qaix) + e | x) - F{qa{x) \ x),F{qa{x) \ x) - F{qa{x) - e | x)}, 



then 



Ve > 0, Vt > 0, \qo,{x) -t\>e^ \F{qa{x) \ x) - F{t \ x)\ > r/(e). 
Now, using (4) and (11) we have 



F{qn,a{x) I x) - F{qa{x) I x) 



FiqnA^) I ^) - Fn{qn,a{^) \ x) 



< sup 

tes 



F{t\x)-Fnit\x) 



(16) 



The consistency of 5n,o follows then immediately from Proposition 3.1, the continuity of F(- \ x) 
and the following inequality 



VP(|gn,a(x) -ga(x)| > e) < V P ( sup|F(t I x) - Fn{t I x)\ > r/(e) 



□ 



Proposition 5.8 Under assum,ptions (A1)-(A5) together with condition (12), we have 



sup 

t&S 



Lit I x) - fit I x) = Oa.s.ih'K + h^n) + Oa. 



logn 

n4){hK) 



l/2^ 



Proof, of Proposition 5.8. 

Following a similar decompositions and steps as in the proof of Propositions 3.1, we can easily prove 
the result of Proposition 5.8. ^ 



Proof, of Theorem 3.2 
Using a Taylor expansion of the function F{^n,aix) \ x) around qaix) we get: 

Fiqn,aix) I X) - Fiqaix) I x) = iqn,aix) - qaix)) f iqn,aix) I x) , 



(17) 



where qnai^) li^^ between qaix) and qn,aix). Equation (17) shows that from the asymptotic be- 
havior of Fiqn,aix) I x) — Fiqaix) I x) as n goes to infinity, it is easy to obtain asymptotic results 
for the sequence iqn,aix) — qaix)). 

Subsequently, considering the statement (16) together with the statement (17), we obtain 



qn,ai^) - Qaix) X / (^^^^(x) | x) 



O { sup 



Fit I X) - Fnit I x] 



Using Lemma 5.7, condition (A3) and the statement (18), we get 



qn,ai^) -qaix) = O ( SUp F(t \ x) - Fnit \ x] 

tes 



(18) 



(19) 
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which is enough, while considering Proposition 3.1, to complete the proof of Theorem 3.2. 

□ 

Proof, of Theorem 3.3 
To proof our result we need to introduce the following decomposition 

Fn{t I x) - F{t I x) := Ji^n + J2,n + Jz,n, 

where Ji,n := F„(t | x) - Fn{t \ x), J2,n ■= Fn{t \ x) - Fn{t I x) and J^^n ■= Fn{t I x) - F{t \ x). 
First, we establish that Ji^n and J^^n are negligible, as n — )■ oo, whereas J2^n is asymptotically 
normal. Observe that the term Ji^„ := Fn{t \ x) — Fn{t \ x) has been studied in Lemma 5.6, then 
we have 



J,,„ = 0„„ i^^'-^j . (20) 

On the other hand the term J^^n '■= Fn{t \ x) — F{t \ x) is equal to Bn{x,t) which uniformly 
converges almost surely to zero (with rate h^^ + /i^) by the Lemma 5.11 given in the Appendix. 
Then, we have 

h,n = Oa.s.{h^K + hH)- (21) 

Now, let us consider the term J2,n which will provide us the asymptotic normality. For this end, 
we consider the following decomposition of the term J2 „. 



J2,n = Fn{t I x) - Fn{t \ x) 
_ Qn{x,t) + Rn{x,t) 



(22) 



where Q„(x,t) := [Fn{x,t)-Fn{x,t)] - F{t \ x){£n{x) - £„(x)) and Rn{x,t) := -Bn{x,t){£n{x) - 
Jn{x)), where Bn{x,t) := ■^]^\ — F[t \ x). Using results of Lemma 5.11, we have, for any fixed 

X € E, Bn{x, t) and therefore Rn{x, t) converge almost surely to zero when n goes to infinity. Thus, 
the asymptotic normality will be provided by the term Qn{x, t) which is treated by the Lemma 5.9 
below. 

Lemma 5.9 Suppose that assumptions (A1)-(A3), (A5), (A8)-(A9) hold, and condition (12) sat- 
isfied, then we have 

■\/n(j){hK) Qn{x,t) — S'A/'(0,(T (x,i)), as n—s- 00, 

where a'^{x,t) is defined in Theorem 3.3. 

Finally, the proof of Theorem 3.3 can be achieved by considering equations (20), (21) and Lemma 
5.9. 

n 
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Proof, of Theorem 3.4 
Using the Taylor expansion of F„(- | x) around qa{x) we get: 

Fn{qa{x) I X) - F{qa{x) I X) = {qa{x) - qn,a{^)) fn {Qn,a{^) I x) , (23) 

where q*^{x) hes between Q'q.(x) and qn,a{x)- 

Then, by combining the consistency result given by Lemma 5.7 and Proposition 5.8, we get 

^ (r)-a(r) - Fniqajx) \ x) - Fiqajx) \ x) 

qn,a[^) qa[X) - f {qa{x) \ x) ^ ' 

Finally, the combination of equation (24) and Theorem 3.3 allows us to finish the proof of Theorem 
3.4. 

Proof, of Corollary 3.5 
First, observe that 



□ 



Mi,„ /n(ga,n(x) | x) / nF^,„(/lj^) 

y^M2,„ y a (G„ [qa,n[x)) - a) 



Mi^nVM / nF:,^n{hK){G-^{qa{x)) - a) fniquAx) I x) ^ 

Mi./M^\ {Gn^{qn,a{x)) - o) h{x)n(k{h k) f{qa{x) \ x) 

Ml I ncp{h)h{x) 



^/M2\| a(G-i(g„(x)) -a 
We have form Theorem 3.4 



-f{qa{x) I x) {qn,a{x) - qa{x)) 



^' I "^^'^^^^"^ -/(,„(x)|x)(^.,(x)-,„(x))AaA(0,1). 



VMaV a(G-i(ga(x))-a)* 

P P F (h ) 

Using results given by Laib and Louani (2010), we have Mi_„ — > Mi, M2^n — ^ -^2 and ,.^'"w^\ - 
1 as n — )■ cxD. 

If in addition, we consider Proposition 5.8, Lemma 5.7, the consistency of G'^^(-) to G^^( 
(given in Deheuvels and Einmahl (2000) ), one gets 



Mi^nVM2 / nF^AhK){G ^{qdx)) - a) fn{qn,a{^)\x) p 

Mi^/M^\ {Gn\qnA^))-o^)h{x)n^{hK) f{qa{x)\x) ^ ' ^^"^°°- 

Therefore, the proof of Corollary 3.5 is achieved. | — | 

Appendix 

Intermediate results for strong consistency 
Proof, of Lemma 5. 5 
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Define the '^pseudo- conditional bias" of tlie conditional distribution function estimate of Yi given 
X = X as 

tn\X) 

Consider now the following quantites 

Rn{x,t) = -Bn{x,t){inix) -In{x)), 

and _ 

Qn{x,t) = {Fn{x,t) - Fn{x,t)) - F{t \ X){£n{x) -Inix)). 

It is then clear that the following decomposition holds 

F„(t I X) - F{t I X) = Bn{x,t) + Rnix,t) + Qnix,t) _ 

in{x) 

Remark 5.10 Using statement (29) and Lemma 5.4, one can easily get, for all x €z E, 

(/ log n \ 
y n(f){hK)J 

Finally, the combination of results given in Lemma 5.11 and Remark 5.10 achieves the proof of 
Lemma 5.5. 

□ 

Lemma 5.11 Assume that hypothesis (A1)-(A5), (A7) and the condition (12) 

SViv\Bn{x,t)\=Oa.s.(h^K + hH) (26) 

™p|R„(.,<)l = 0..((4 + '."«)(;|^)'"). (27) 

Proof, of Lemma 5.11 
Recall that 

Fn{x,t) _ Fn{x,t)-In{x)F{t\x) 

Dn\X,l) — - r\l\Xj— 1 ( \ 

By double conditioning with respect to the cr- field Qi-i and Tj and using assumption (A4) and the 



17 



fact that ]l|r,<cjV'(^i) = ^{T,<C^}V{T^), we get 

^ 1 " 

Fnix,t) = -^^^^-^^J2^{A,{x)E[6iG-\Yi)H{hJj\t-Yi))\g,^i,Ti]\Ti-i} 

1 " - 

1 " 

Then, by a double conditioning with respect to Qi-\^ we have 

^ - 1 " 

F„(x, t) - Jn{x)F{t I x) = -^^^-^ ^E {Ai(x)[E(/f (/i^H* - r^)) I ^0 - Fit \ x)\ \ J^_i} 

Now, because of conditions (A3) and (A5), we get 

E{H{hJj\t - Ti)) I Xi) - F{t \x) <C, [ H^^\u) (4 + |nr/i^) du. (28) 

Jr ^ ' 

Therefore, we obtain 

F,,{x,t)-Jn(^x)F(t\x) = Oa.s.[h''j, + h'ij)x——--Y,^{Aiix)\Fi.i} 

i=l 

Similarly as in Lemma 5.4, it is easily seen that in{x) = Oa.s.(l)- Thus, we obtain Fn{x,t) — 

In{x)F{t \ x) = Oa.s. [h^K + h'^n) ■ 

The second part of Lemma 5.11 follows easily from the fact that Rn{x, t) = —Bn{x, t){in{x) —Jn{x)), 

the statement of (26) and Lemma 5.4, we get 



SUp\Rn{x,t)\=Oa.s. { K + ^h) f^l^l 

tes \ \n<f>{hK)J 



1/2N 



□ 



Lemma 5.12 Assume that (A1)-(A2) and (A4)-(A7) are satisfied. Then, for any x £ E, we have 
sup |F„(x, t) - Fn{x, t)\ = Oa.s. ( f ^^) ) • (29) 
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Proof, of Lemma 5.12 
Observe that 



Fnix,t) - Fn{x,t) 



nE(Ai(x)) ^ 



7 ^Li^n{x,t), 



where Li,„(x, t) = 5iG~\Yi)H{hH\t - Yi))^i{x) - E {5iG-\Yi)H{hH\t - Yi))^i{x) \ Fi^i) is 
a martingale difference. Therefore, we can use Lemma 5.2 to obtain an exponential upper bound 
relative to the quantity Fn{x,t) — Fn{x,t). Let us now check the conditions under which one can 
obtain the mentioned exponential upper bound. In this respect, for any p G N — {0}, observe that 

LU^^t) = J2c'p f p^ H{hjl{t - Y))Mx)) i-iy-' \e (J^ Hihjlit - Y))Mx) I F.-i 



k=0 



G{Y.) 



\GiYi) 



p—k 



]p—k 



In view of condition (A4), [E (^6iG~^ (Yi) H{hj/{t -Yi))Ai{x) \ Fi-i)Y is -Fj_i-measurable, it 
follows then that 



E{LlJx,t) I F,.i) = Y,C^E \{6,G-\Yi) H{h],\t -Yi))A,ix)f \ F^^ (-If 



k=0 



o—k 



[E {6iG-\Y) H{hjl{t - Y))Mx) I -^^-i)] 



p—k 



Thus, 



E{LPjx,t) I Fi-i) < Y.^P^ \\SiG-Hy^) H{h-^\t - Yi))A,[x)\'' \ Fi 



fc=0 



[E {\5iG~HY,) Hihjj\t - Yi))\{x)\ I Fi^i)] 
Making use of Jensen inequality, one can write 



j-i 



p—k 



E 



6iG-'{Y,) H{h-^'{t - KO)A,(x)p I Fi 



j-i 



[E {\5,G-\Yi) Hihjj^t - y.))A.(x)| I F,-i)f '' < 
E {\6iG-\Yi) H{h-^'{t - yi))Ai(x)P I Fi-i) E (^\5iG-\Yi) H{h],\t - Yi))Aiix)f~^ \ Fi.i 

Observe now that for any m > 2 



E ( \6,G-'{Y,) H{h-^'{t - Y,))Ai{x)\- \ Fi^i ) < 

< 



1 



{G{T)y 
1 



-E{H"^{h-HHt-Y,))AT{x)\F,.,) 



{G{T)y 



-E{A^{x)grr,{Xi,t)\Fi-l). 
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In view of assumption (A6), we have 
6^ 



E 



G{Yi) 



H{hjl{t-Yi))A,{x] 



Ti 



j-i 






< 



< 



1 



+5m(2;,i)] 



sup \gm.{x' ,t) - grn{x,t) 
x'€B{x,h) 



where Cq is a positive constant. By using Lemma 5.3, conditions (A2)(ii) and (A2)(iii), whenever 
the kernel K and the function tq are bounded by constants ai and ci respectively, we get, for m = k, 

E[Af (x) I J-i_i] = (t){hK)Mkfi,i{x) + Oa.sXgiAhK)) = ci4){hK)a\fiAx) + OaAaiA^K))- 



Similarly, with m = p — k, we get 



ip— fc 



E \6iG-'{Yi) H{hjj'{t - Yi))A,{x)Y I Fi^i = ci(p{hK)al-' fi,i{x) + OaAaiAhK))- 



-,p-k . 



Therefore, 



E \6iG-'{Yi) Hih-^'it - yi))A,(x)P I J-,_i E \5iG-\Yi) H{h],'{t - Yi))A,{. 



\p~k 



T, 



i-l 



p^k\ 



cialAhKY ftA^) + OaA9iAhK))<P{hK)fiAx){a1 + <'") + OaAgtAhK))- 

Since fi,i{x) is almost surely bounded by a deterministic quantity bi{x), QiA^k) ^ A^k) almost 
surely and </)(/ix)^ < (p^hx), for n sufficiently large, then following the same arguments as in the 
proof of Lemma 5 in Laib and Louani (2011), one may write almost surely, 

E(LfJx,t) I J-,_i)| =plCP'^[C2HhK)nAx) + OaA9iAhK))]<plCP-^HhK)[Mbi{x) + l], 

where C = 2max(l,af) and C2 a positive constant. By taking df = (/){hK)[Mbi{x) + 1], then 
Dn = X^iLi d'f ^iicl by assumptions (A2)(ii) and (A2)(v) one gets n~^Dn = (/>(/iA')[MZ)(x)+Oa.s. (1)] 
as n — )• 00, we now use the Lemma 5.2 with D^ = Oa.sXnAhx)) and S„ = Xir=i ^n,i{x,t). Thus, 
for any eo > 0, we can easily get 



Fn{x,t) - Fn{x,t) 



> £01 



logn 



n(f>{h 



K 



^Ln,i{x,t) > nE(Ai(x))eo^ 



logn 



4 = 1 



n((){h 



K 



2 logn 



< 2 exp 



(^IE(Ai(x))6o)^4^ 



2D„ + 2CnE(Ai(x))6oJ4;|^ 



< 2exp{-Cieglogn} = -— ^, 

n 1 
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where Ci is a positive constant. Therefore, choosing eo large enough, we obtain 

Fn{x,t) - Fn{x,t) 



n>l 



Jlogn 
— — — r I < oo. 



n(f>{h 



K 



Finally, we achieve the proof by Borel-Cantelli Lemma. 

Proof, of Lemma 5.6 
From (8) and (9) we have 



n 



Fn{t I X) - Fn{t I X] 



< 



rM[/\i{x)]in{x_ 



E 



5A^{x) H{h],\t-Yi)) 



1 



1 



G{Yi} Gn{Y,) 



- G^{r) ^"^* ' ^^ 



Since G{t) > 0, in conjuction with the Srong Law of Large Numbers (SLLN) and the Law of the 
Iterated Logarithm (LIL) on the censoring law (see Theorem 3.2 of Cai and Roussas (1992), the 
result is an immediate consequence of Lemmas 5.5. 

□ 



Intermediate results for asymptotic normality 



Proof, of Lemma 5.9 
Let us denote by 



Hh 



K, 



n 



1/2 



^'^ Hih],Ht-m-F{t\x)^ ^^^'^^ 



G{Yi) 



n^i{x)y 



(30) 



and define ^ni '■= Vm — ^[vm \ -^i-i]- It is easy seen that 

n 
in(t>ihK))'^^Qnix,t) = ^^„ 



(31) 



i=l 



where, for any fixed x € E, the summands in (31) from a triangular array of stationary martingal 
differences with respect to the a-field J-i-i. This allows us to apply the Central Limit Theorem for 
discrete-time arrays of real- valued martingales (see. Hall and Heyde (1980), page 23) to establish 
the asymptotic normality of Qn{x,t). Therefore, we have to establish the following statements: 

(a) Etlneni\^^-l]^^'{x,t), 

(b) nE[^^^ lint ,|>^i] = o(l) holds for any e > (Lindeberg condition). 
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Proof of part (a). 

Observe that 



Y^nril I -^^-i] -Y.^[fm I -^.-i]| < Y.^nrim i ^i^i]? 



i=l 



i=l 



Using Lemma 5.3 and inequality (28), we obtain 

1 /(/>(/li^)^'/' 



IE[r?m \J^i-i\ 



E(Ai(x)) V n 

Oa.s. (h^K + ^H 



E 



n 



Ai(a;) 

1/2 



5i 



G{Yi) 
ct>{hK)y'UfiA^) 



Hihjj\t-Yi))-F{t\x)] \Ti-i 



fiix) 



+ Oa.s 



gi,x{hK) 

4>{hK) 



(32) 



Then, by (A2)(ii)-(iii), we get 

" / 2 

^(E[r?„i I J-,_i])2 = Oa.s. ( {h^K + ^h) <t>{hK] 
1=1 ^ 

The statement of (a) follows then if we show that 

n 

lim J]E[r?2. I J-, 



-i-i\ 



a\x,t). 



(33) 



i=l 



To prove (33), observe that, using assumption (A8), we have 



Y,nvl^\J'^ 



i-1 



(p{hK) 



i=l 



J2^U]{x) ^-^^H{h-^\t - m - F{t I x)^ I j-._i| 



n(E(Ai(x)))2 ^ 
n(E(Ai(.)))2A.^|^^^^^^ 



<5^ 
G(KO 



i7(/i^i(t-yi))-^(i|^i)) l^i 






i-1 



Using the definition of the conditional variance, we have 



E 



G{Y,y 



H{h]j\t-Yi))-F{t\Xi)] \X, 



var 



G{Y^) 

G{Y,) 



H{h~H\t-Yi))\Xi 



+ 



E I -^^^^Hihjlit - Yi)) \Xi]-F{t\ x) 



-\2 



(34) 



By the use of a double conditioning with respect to Tj, inequality (28), assumption (A3) and 
Lemma 5.3, we can easily get 



<P{h 



K 



n(E(Ai(x)))2 ^ 



^E {A2(x)i^„2 I -F,_i} = Oa.s. (K + hH 



M2 1 
MfMx) 



Oa.s.(l) 



(35) 



22 



Let us now examine the term Kni, 



K.. 



nl 



E 



H' 



t-Yi 



X1+X2. 



Xi 



E ( -^H (^-^ 1 I X, 
G{Yi) \ hn 



The first term of the last equaUty can be developed as follow, 



E 



H' 



H' 



t-Y\ 1 



hH ) G(y,) 



Xi 



t- z\ 1 



-/(z I Xi)dz 



hn J G{z) 

H\v) ^.^ \ , dFit - hHV I X,). 
G{t — hHv) 

By the first order Taylor expansion of the function G~^{-) around zero one gets 



Xi := / H\v)-^dF{t - hHV I Xi) + 



hn 
&{t) 



vH{v)&^\t'')dF{t - hv I Xi) + 0(1) 



-'■ X^ +X2, 



sup„eM|G(i){M)| 



where t* is between t and t — hfjv. 

Under assumption (A9), we have X2 < /j,2^ '^"P"g'»J^ '■"-'I J^^y(i_/j^^ | Xi)dv. Then, using assump- 
tion (A3), we get l'^ = 0{h]j). 

On the other hand, by integrating by part we have 

I[ = J- [ 2H'{v)H{v)F{t - hHV I Xi)dv 

= ^ f 2H'{v)H{v) {F{t - hHV I Xi) - F{t \ x)) dv + J- [ 2H'{v)H{v)F{t \ x)dv. 

Lr(.*j JR G\t) Jr 



Then, under assumption (A3), we get Z[ = ^j^^' + 0{h^ + /i^) and therefore 



X 



G{t) 



G{t) 



+ 0{h^^ + h-H) + 0{hij). 



(36) 



Finally, we get 

4>{hK) 
n(E(Ai(x)))2 ^ 



J;e{A2(x)K„i| J-,_i} = {0{h^^ + h'i,) + 0{hl) + ^!^^J^-iF{t\x))^]x 



4>{hK) 



n(E(Ai(x)))2 ^ 



G{t) 
5^E(A2(x)|F._i) 



, iiix.„->oo n(E(AiOi!)))2 Er=i ^ {^K^)-^n2 | X^-i} = 0, almost surely and 



Then, lim„ — vLjil 
(j){hK 



,.-» „(E(A, (.)))=- g^{^-W^- I ^-'» = {^ - (^C I ■'^» 



lim 



2 \ I M2 I 



Mf/i(x: 
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Therefore, 



Y.^A\:F.-.\ = ['W^-m\-^)AJ'"' ' 



Git) 



This is complete the Proof of part (a). 



Mlh{x) 



-: a{x,t). 



Proof of part (b). 

The Lindeberg condition results from Corollary 9.5.2 in Chow and Teicher (1998) which implies 
that nE[^^.]ij|^^^^^|j] < 4nE[r/^.]l[|^^^.|>^/2]]- Let a > 1 and 6 > 1 such that 1/a + 1/6 = 1. Making 
use of Holder and Markov inequalities one can write, for all e > 0, 



H^nihvm\>e/2]] 



< 



E|7?„ 



1 2a 



(e/2)Wfe- 



Taking Cq a positive constant and 2a = 2 + 5 (with 6 as in (A8)), using the condition (AS) and a 
double conditioning, we obtain 



E I 

< Co 

< Co 
Now, using Lemma 5.3, we get 
4nE[r?^i]l[|^,^^l>,/2]] < Co(n(/)(/ii^)) 



HhK) 
n 

6i 



{2+5)/2 



n 



(E(Ai(x))) 



2+5 



H{hJj'it-Yi))-F{t\x)A,{x) 



G{Yi) 



n2+5^ 



n 



n 



(E(Ai(x)))2+5 
0(/ij^)V^+'^)/2nE[(Ai(x))2+^ 



E 



n 



(E(Ai(x))) 



(A,(x))2+V2+5(t I X, 
^ {\W2+5{t\x)\+0{l)) 



-5/2 



(M2+5)/i(x)+o(l) 



{Ml+' fl+\x)) + o{l) 
This completes the proof of part (b) and therefore the proof of Lemma 5.9. 



{\W2+5{t\x)\+o{l)) = 0{{n<t^{hK))-"^) 



n 
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